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(54) Data inserting apparatus in a digital video broadcasting system 



(57) A repeat use data inserting apparatus, for re- 
peatedly inserting repeat use data into program data in 
accordance with appropriate timings, comprises a data 
holding unit (760) and a data multiplexing unit (720(1) - 
(N)). The data holding unit (760) holds the repeat use 
data made of a plurality of material data in the form of 
separately encoded streams. The data multiplexing unit 
(720(1) - (N)) multiplexes separately encoded streams 



of a plurality of material data constituting the program 
data during a period other than a data insertion period 
during which the repeat use data is inserted into the pro- 
gram data. The data multiplexing unit (720(1) - (N)) fur- 
ther inserts repeatedly the repeat use data into the pro- 
gram data during the data insertion period by multiplex- 
ing the separately encoded streams of the plurality of 
material data constituting the repeat use data held in the 
data holding unit (760). 
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Description 

The present invention relates to a repeat use data 
inserting apparatus for inserting repeat use data into 
- program data in accordance with appropriate timings, 5 
as well as to a digital broadcast transmitting system 
which comprises the repeat use data inserting appara- 
tus and which transmits a unified stream of program da- 
ta and repeat use data prepared by the repeat use data 
inserting apparatus. w 

Recent years have seen the commercialization of 
multi-channel digital broadcasting systems using ad- 
vanced digital compression techniques to transmit nu- 
merous channels of program data in a single data 
stream The multi-channel digital broadcasting system ?5 
needs to have the capability of repeatedly inserting so- 
called repeat use data into each of a plurality of channels 
of program data in accordance with suitable timings. In 
the context of this specification, repeat use data refers 
lo repeatedly used data during broadcast such as news 20 
clips and commercial messages. 

It is an aim of at least a preferred embodiment of 
the present invention to provide a repeat use data in- 
serting apparatus and a digital broadcast transmitting 
system using the apparatus, whereby the storage ca- 2S 
pacity and transfer rate for repeat use data are reduced, 
the process for changing time base information is elim- 
inated, momentary interruption of video or audio data is 
averted, and generation of noise is suppressed. 

One aspect of the present invention provides a re- 30 
peat use data inserting apparatus for repeatedly insert- 
ing repeat use data into program data in accordance 
with appropriate timings, and a digital broadcast trans- 
mitting system for use with that apparatus, the repeat 
use data inserting apparatus comprising; data holding 3S 
means for holding the repeat use data made of a plural- 
ity of material data in the form of separately encoded 
streams: and data multiplexing means for multiplexing 
separately encoded streams of a plurality of material da- 
ta constituting the program data during a period other 40 
than a data insertion period during which the repeat use 
data is inserted into the program data, the data multi- 
plexing means further inserting repeatedly the repeat 
use data into the program data during the data insertion 
period by multiplexing the separately encoded streams 45 
of the plurality of material data constituting the repeat 
use data held in the data holding means. 

In the repeal data inserting apparatus and digital 
broadcast transmitting system of the invention, the re- 
peat use data is held by the data holding means in the so 
form of separately encoded stream of the plurality of ma- 
terial data. In that setup, during a period other than the 
data insertion period, the data multiplexing means mul- 
tiplexes the separately encoded streams of the plurality 
of material data constituting the program data. During ss 
the data insertion period, the data multiplexing means 
multiplexes the separately encoded streams of the plu- 
rality of material data constituting the repeat use data 



held in the data holding means. 

The program data and the repeat use data are mul- 
tiplexed as described, and so are the separately encod- 
ed streams constituting the material data. As a result, a 
bit stream of repeat use data is repeatedly inserted into 
a bit stream of program data, whereby a unified stream 
of data is acquired. 

The invention will now be described by way of ex- 
ample with reference to the accompanying drawings, 
throughout which like parts are referred to by like refer- 
ences, and in which: 

Fig. 1 is a blockdiagram of a repeat use data insert- 
ing apparatus and a digital broadcast transmitting 
system embodying the invention; 
Fig. 2 is a conceptual view showing how program 
data are typically subjected to multiplexing and sep- 
arating processes; 

Fig. 3 is a schematic view sketching how program 
data and repeat use data are multiplexed; 
Fig. 4 is a blockdiagram showing how encoder-mul- 
tiplexers and a sen/er are illustratively configured; 
Fig. 5 is a schematic view of a data storage structure 
in a hard disk array; 

Figs. 6A, 6B and 6C are views of typical file struc- 
tures for commercial data; 

Fig. 7 is a flowchart of steps in which a multiplexing 
controller operates illustratively; 
Fig. 8 is a flowchart of steps in which a disk control- 
ler operates illustratively; 
Fig. 9 is a view of a typical commercial list; 
Fig. 1 0 is a schematic view showing the storage ca- 
pacity of an FIFO memory unit: 
Figs. 11 A, 1 1 B and 1 1 C are schematic views show- 
ing how video data held in the FIFO memory unit 
vary; 

Fig, 12 is a block diagram of a system adopting a 
hitherto-proposed arrangement for inserting repeat 
use data into program data; and 
Fig. 1 3 is a block diagram of a system adopting an- 
other hitherto-proposed arrangement for inserting 
repeat use data into program data. 

A repeat use data inserting apparatus and a digital 
broadcast transmitting system both emtDOdying the in- 
vention will now be described in detail with reference to 
the accompanying drawings. 

So far. repeat use data is inserted into program data 
through the use of one of two data inserting arrange- 
ments proposed as follows: the first arrangement in- 
volves having repeat use data not compressed upon in- 
sertion into the program data. The second arrangement 
requires that repeat use data be subject to compressed 
encoding and multiplexing before being inserted into 
program data. 

Fig. 12 is a block diagram of a multi-channel digital 
broadcasting system adopting the first arrangement for 
inserting repeat use data into program data. 
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The multi-channel digital broadcasting system of 
Fig. 12 comprises a digital broadcast transmitting sys- 
tem 100 installed in a broadcasting center a communi- 
cation satellite 200 for relaying transmitted data from the 
digital broadcast transmitting system 100, and a digital 
broadcast receiving system 300 installed in each view- 
er's household to receive the data relayed by the com- 
munication satellite 200. 

The digital broadcast transmitting system 100 has 
N video tape recorders (VTRs) 110(1) through 110(N) 
for N channels (N is an integer of at least 2). a change- 
over switch 120, N encoder-multiplexers 130(1 ) through 
130(N) for the N channels, a multi-channel developing 
unit 140, a transmitting antenna 150. and a server 160 
for managing uncompressed repeat use data. Each dig- 
ital broadcast receiving system 300 includes a receiving 
antenna 310 and a receiving terminal 320. 

In the setup above, during a period where repeat 
use data is inserted into n (n = i - N) channels of pro- 
gram data (the period is called a data insertion period), 
uncompressed repeat use data from the server 160 is 
fed through the changeover switch 120 to the corre- 
sponding encoder-multiplexers I30(n). During a period 
other than the data insertion period (called a data non- 
insertion period), the program data from as many as n 
VTRs 110(n) for n channels are supplied through the 
changeover switch 1 20 to the encoder-multiplexers 1 30 
(n). 

The data fed to the encoder-multiplexers 1 30(n) are 
compressed and encoded in terms of individual material 
data types (video data, audio data, etc.) before being 
multiplexed. The compression, encoding and multiplex- 
ing processes are implemented illustratively on the ba- 
sis of MPEG (Moving Picture Experts Group) 2 specifi- 
cations. 

Multiplexed outputs comprising N channels of data 
are developed into multiple channels by the multi-chan- 
nel developing unit 1 40 before being transmitted via the 
transmitting antenna 150. The transmitted data is re- 
layed by the communication satellite 200 and received 
by the receiving antenna 310. The receiving terminal 
320 separates data of a desired channel from the re- 
ceived data, decodes the separated output and repro- 
duces the decoded data. 

Fig. 1 3 is a block diagranrfof a multi-channel digital 
broadcasting system adopting the second arrangement 
for inserting repeat use data into program data. 

The system of Fig. 13 includes a digital broadcast 
transmitting system 400. a communication satellite 500 
and a digital broadcast receiving system 600. The digital 
broadcast transmitting system 400 comprises VTRs 41 0 
(1) through 410(N). a changeover switch 420, encoder- 
multiplexers 430(1 ) through 430(N). a multi-channel de- 
veloping unit 440, a transmitting antenna 450, and a 
server 460 for managing repeat use data. The digital 
broadcast receiving system 600 has a receiving anten- 
na 610 and a receiving terminal 620. 

In the system of Fig. 13, the server 460 manages 



the repeat use data that are encoded and multiplexed. 
That is, the server 460 manages the repeat use data in 
the form of an MPEG2-based final bit stream called a 
transport stream. The repeat use data are fed to the mul- 

5 ti-channel developing unit 440 during the data insertion 
period on n channels, to be multiplexed with the n chan- 
nels of program data. 

The above-described two arrangements for insert- 
ing repeat use data into program data have the following 

10 problems: 

(1) The first arrangement uses uncompressed re- 
peat use data. This amounts to an enormous quantity 
of repeat use data that must be accommodated by a 
storage medium of a sufficiently large capacity. 

'5 Generally, individual repeat use data items are lim- 
ited in quantity. On the other hand, a multi-channel 
broadcast setup typically requires having about 1,000 
items of repeat use data stored in the storage medium 
dedicated to such data. The total amount of repeat use 

20 data to be stored is huge even though the individual data 
items are small. Thus the first arrangement for inserting 
repeat use data into program data requires the use of a 
storage medium of a considerably large capacity. 

Furthermore, the first arrangement above requires 

25 establishing for repeat use data a transfer rate high 
enough to coverall channels. The reason for this is that 
it is sometimes necessary to broadcast different com- 
mercial messages and news clips simultaneously on all 
channels. Thus the first arrangement for repeat use data 

30 insertion requires the use of a high-speed storage me- 
dium for holding repeat use data. 

(2) The second arrangement for inserting repeat 
use data into program data involves having repeat use 
data compressed for storage. This means that the stor- 
es age medium for accommodating repeat use data may 

be small in capacity and that the transfer rate for repeat 
use data may be lowered. Still, the need to have the re- 
peat use data stored in a multiplexed fashion requires 
changing time base informatbn (i.e., time management 
40 information) whenever the data are inserted into pro- 
gram data. 

The second arrangement above has another prob- 
lem. When program data and repeat use data are 
switched at a given point in time and transmitted, the 

45 video or audio part of the program can be interrupted 
momentarily or can generate noise upon such switcho- 
ver. This is because the mulli<hannel digital broadcast- 
ing system, in an attempt to reduce the capacity of a 
buffer memory on the part of the receiving system 600. 

so causes the transmitting system 400 to multiplex video 
data and audio data using time differences. 

Fig. 1 is a block diagram of a digital broadcast trans- 
mitting system comprising a repeat use data inserting 
apparatus, the system and the apparatus embodying 

55 the invention. 

The transmitting system of Fig. 1 comprises VTRs 
710(1) through 710(N) corresponding to N channels (N 
is an integer of at least 2) and generating program data. 



BNSOOCID: <EP 0838957A2J_> 



3 



5 



EP 0 838 957 A2 



6 



encoder-multiplexers 720(1) through 720(N) that en- 
code and multiplex the program data from the VTRs710 
(1) through 710(N). a changeover switch 730 that con- 
nects the VTRs 710(1 ) through 710(N) with the encoder- 
multiplexers 720(1 ) through 720(N). a multi-channel de- 
veloping unit 740 that develops multiplexed outputs 
from the encoder-multiplexers 720( 1 ) through 720(N) in- 
to multiple channels, a transmitting antenna 750 that 
transmits the multi-channel output from the multi-chan- 
nel developing unit 740, and a server 760 that manages 
repeat use data. 

The server 760 manages the repeat use data in the 
form of separately encoded streams (elementary 
streams) representing a plurality of material data. The 
material data constituting the repeat use data typically 
include video data and audio data. The material data 
are generally compressed and encoded in accordance 
with MPEG2 specifications. 

The setup above works as follows: during a data 
noninsertion period on n channels (n = 1 - N), the pro- 
gram data from the VTRs 710(n) for the n channels are 
fed via the changeover switch 730 to the encoder-mul- 
tiplexers 720(n). 

Having reached the encoder-multiplexers 720(n), 
the program data are compressed and encoded thereby 
in terms of individual material data types according to 
MPEG2 specifications. The process provides separate- 
ly encoded streams reflecting the individual material da- 
ta. Video data and audio data generally hnake up the 
material data constituting the program data. 

A plurality of separately encoded streanns from the 
data compression and encoding process above are mul- 
tiplexed in accordance with MPEG2 specifications. This 
provides a single stream that unifies the separately en- 
coded streams. The single stream is called a transport 
stream, one of MPEG2-based packet streams. 

During a data insertion period, the encoder-multi- 
plexers 720(n) are supplied with the separately encoded 
streams representing a plurality of material data consti- 
tuting the repeat use data held in the server 760. The 
separately encoded streams fed to the encoder-multi- 
plexers 720(n) are multiplexed thereby according to 
MPEG2 specifications. The process provides a single 
stream (transport stream) that unifies the separately en- 
coded streams. 

As described, the encoder-multiplexers 720(n) for 
the n channels multiplex the program data and repeat 
use data over (he n channels, as well as the separately 
encoded streams representing the plurality of data con- 
stituting the data. In this manner, the process turns pro- 
gram data bit streams into a single stream into which 
repeat use data bit streams are inserted in accordance 
with predetermined timings. 

In the multiplexing process, time base information 
is provided in order to synchronize the video and audio 
data. The time base information includes a decoding 
time stamp (DTS) indicating when to decode video data 
and audio data, a presentation time stamp (PTS) spec- 



ifying when to reproduce and output the decoded video 
and audio data, and system clock reference (SCR) as 
well as program clock reference (PGR) designating the 
clock reference for decoding, reproduction and output. 

5 The single stream coming out of the encoder-mul- 
tiplexers 720(1) through 720(N) for the N channels is 
developed by the multi-channel developing unit 740 into 
multiple channels. That is, the unified stream represent- 
ing the N channels is first multiplexed and then encoded 

10 and modulated in preparation for transmission. The mul- 
ti-channel output is transmitted via the transmitting an- 
tenna 750. 

Fig. 2 is a conceptual view showing a multiplexing 
and a separating process dealing with separately en- 

15 coded streams representing a plurality of material data 
constituting program data. The setup of Fig. 2 indicates 
audio data that is typically composed of two kinds of au- 
dio data, one in Japanese and the other in English. 
Separately encoded streams ST11 through STI 3 

20 representing the three kinds of material data are multi- 
plexed by the encoder-multiplexers 720(n). The process 
provides a single stream ST20 that unifies the three en- 
coded streams ST11 through STI 3. The unified stream 
ST20 is later separated into the separately encoded 

25 streams STII through ST13 by a receiving terminal in- 
cluded in the digital broadcast receiving system. The 
separately encoded streams denoting the repeat use 
data are also multiplexed and then separated in a similar 
manner, which will not be described further 

30 Fig. 3 is a schematic view sketching how program 
data and repeat use data are multiplexed. Fig. 3 shows 
an example in which program data is constituted by 
movie data and repeat use data is made of commercial 
data CM (commercial messages). Furthermore^ the 

35 movie data comprises video data, audio data in Japa- 
nese, and audio data in English; the commercial data 
includes video data and audio data in Japanese. 

As shown in Fig, 3, during data noninsertion periods 
TN(1 ), TN(2). etc., the separately encoded streams rep- 

40 resenting the three material data constituting the movie 
data are multiplexed. During data insertion periods Tl 
(1). etc., on the other hand, the separately encoded 
streams representing the two material data constituting 
the commercial data are multiplexed. The movie data 

45 and commercial data are thus multiplexed, and so are 
the separately encoded streams denoting the plurality 
of material data constituting these data. The process 
eventually provides a single stream that unifies ihe sep- 
arately encoded streams representing the movie data 

50 and the streams representing the commercial data. 

Fig. 4 is a block diagram showing how the encoder- 
multiplexers 720(n) and the server 760 in Fig. 1 are il- 
lustratively configured. 

As shown in Fig, 4, each encoder-multiplexer 720 

55 (n) includes a video encoder 721 (n) that compresses 
and encodes video data VD constituting the program da- 
ta from the VTR 710(n), and an audio encoder 722(n) 
that likewise compresses and encodes audio data AD. 
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Fig. 4 shows an example in which one type of audio data 
AD is furnished. 

The encoder-multiplexer 720(n) further comprises 
a video first-in first-out (FIFO) memory unit 724(n) for 
temporarily accommodating the video data VD consti- s 
tuting the repeat use data from the server 760, an audio 
FIFO memory unit 725(n) for temporarily holding the au- 
dio data AD from the server 760. and an FIFO control 
circuit 726(n) for detecting the quantity of the remaining 
data in the FIFO memory units 724(n) and 725(n). io 

In addition, the encoder-multiplexer 720(n) has a 
multiplexer 727(n) and a multiplexing controller 728(n) 
that controls the multiplexer 727(n) in operation. The 
multiplexer 727(n) multiplexes, in accordance with 
MPEG2 specifications, two separately encoded is 
streams coming from the encoders 721 (n) and 722(n) 
and another two separately encoded streams from the 
FIFO memory units 724(n) and 725(n). The multiplexing 
controller 728 is implemented illustratively by use of a 
central processing unit (CPU). 20 

The server 760 comprises a hard disk array 761 for 
holding the repeat use data, and a disk controller 762 
for controlling the hard disk array 761 . The disk control- 
ler 762 is implemented illustratively by use of a compu- 
ter. 25 

Fig. 5 is a schematic view of a data storage structure 
in the hard disk array 761 . The example of Fig. 5 shows 
repeat use data typically composed of commercial data. 
As illustrated, the hard disk array 761 has a file estab- 
lished for each of commercial messages CM(m) (m = 1 , 30 
2. etc.). 

As shown in Figs. 6A through 6C. each file accom- 
modating a commercial message CM(m) comprises a 
video file VF(m) (see Fig. 6A) for storing video data VD. 
an audio file AF(m) (see Fig. 68) for holding audio data 55 
AD. and a size file SF(m) (see Fig. 6C) for retaining size 
data VSD and ASD. 

The video file VF(m) has the video data VD stored 
in increments of frames. The audio file AF(m) has the 
audio data AD stored also in increments of frames. The 40 
size file SF(m) contains the size data VSD designating 
video data sizes and the size data ASD specifying audio 
data sizes, the two types of size data being stored in 
increments of frames. 

The video data VD and audio data AD are stored in ^5 
the form of separately encoded streams. The size data 
VSD and ASD, as they are stored, indicate the sizes in 
effect when the video data VD and audio data AD were 
compressed and encoded. The compression and en- 
coding process above is carried out illustratively by one so 
of the encoder-multiplexers 720(1) through 720(N) for 
program data while no program data is being com- 
pressed or encoded. 

The setup above works as follows: during a data 
noninsertion period for each of n channel, the video data ss 
VD constituting the program data from the VTR 710(n) 
in Fig. 1 is fed to the video encoder 721 (n); the audio 
data AD also making up the program data is fed to the 



audio encoder 722(n). The video data VD and audio da- 
ta AD supplied to the encoders 721 (n) and 722(n) are 
compressed and encoded thereby in accordance with 
MPEG2 specifications. The process provides separate- 
ly encoded streams representing the video data VD and 
audio data AD. The two separately encoded streams are 
multiplexed by the multiplexer 727(n) into a unified 
stream (called a transport stream). 

Also during the data noninsertion period for each of 
the n channels, the FIFO memory units 724(n) and 725 
(n) are supplied with the separately encoded streams 
representing the video data VD and audio data VD con- 
stituting the commercial data held in the hard disk array 
761 . The separately encoded streams thus transferred 
to the FIFO memory units 724{n) and 275(n), reflecting 
the video data VD and audio data AD. are multiplexed 
by the multiplexer 727(n). The multiplexing process pro- 
vides a single stream (transport stream) that unifies the 
two separately encoded streams. 

The multiplexer 727(n) is controlled in operation by 
the multiplexing controller 728(n). The transfer of the 
separately encoded streams from the hard disk array 
761 to the FIFO memory units 724(n) and 725(n) is con- 
trolled by the disk controller 762. 

Fig. 7 is a flowchart of steps in which the multiplex- 
ing controller 728(n) operates illustratively. In the exam- 
ple of Fig. 7, it is assumed that repeat use data is com- 
mercial data. How the multiplexing controller 728(n) 
works will now be described with reference to Fig. 7. 

In operation, the multiplexing controller 728(n) first 
requests the disk controller 762 to transfer commercial 
data (step SI 01 ). In turn, the data constituting the com- 
mercial message CM(m) held in the hard disk array 761 
is transferred therefrom to the FIFO memory units 724 
(n) and 725(n). 

In the case above, the FIFO memory unit 724(n) is 
fed with the separately encoded stream representing 
the video data VD held in the video file VF(m) for the 
commercial message CM(m); the FIFO memory unit 
725(n) is supplied with the separately encoded stream 
representing the audio data AD held in the audio file AF 
(m). The data transfer process is carried out until the 
storage capacities of the FIFO memory units 724(n) and 
725(n) are exhausted. The storage capacities are preset 
so as to accommodate data comprising a plurality of 
commercial messages CM(m). This means that the 
FIFO memory units 724(n) and 725(n) will hold data con- 
stituting multiple commercial messages Cfy/l(m). 

The multiplexing controller 728(n) then controls 
multiplexing of program data (step SI 02). Under control 
of the controller 728(n), the multiplexer 727(n) multiplex- 
es the separately encoded streams of the video data VD 
and audio data VD compressed and encoded by the en- 
coders 721 (n) and 722(n). 

More specifically, the multiplexing process is con- 
trolled as follows: the multiplexing controller 728(n) asks 
the encoders 721 (n) and 722(n) for size data VSD and 
ASD representing the sizes of the video data VD and 
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audio data AD. In response, the encoders 721 (n) and 
722(n) supplies the multiplexing controller 728(n) with 
the size data VSD and ASD representing a plurality of 
f rannes (e.g. , 1 5 frames) of video data VD and audio data 
AD. 

Given the size data VSD and ASD about the multi- 
ple-frame data, the multiplexing controller 728(n) devis- 
es a plan to multiplex the video data VD and audio data 
AD. The multiplexing plan is a plan that specifies the 
quantities of video data VD and audio data AD to be mul- 
tiplexed and the timings used for such multiplexing. The 
plan is provided so that video data VD may be com- 
pressed and encoded by a variable-length compression 
and encoding method. Without such a plan, the multi- 
plexing process would involve unevenly transmitted ex- 
cesses and shortages of video data VD leading to an 
imbalance between video data VD and audio data AD. 

The multiplexing plan is established in increments 
not of a single frame but of a plurality of frames. This is 
because the plan needs to be optimized so as to take 
into consideration changes in data size per frame. 

On the basis of the multiplexing plan thus devised, 
the multiplexing controller 728(n) requests the encoders 
721 (n) and 722(n) to transfer separately encoded 
streams representing a plurality of frames. At the same 
time, the multiplexing controller 728(n) requests the 
multiplexer 727(n) to multiplex the plurality of frames of 
separately encoded streams. As a result, the encoders 
721 (n) and 722(n) output the multiple frames of sepa- 
rately encoded streams in accordance with the multi- 
plexing plan. These separately encoded streams are 
multiplexed by the multiplexer 727(n) according to the 
multiplexing plan. 

When control over the multiple-frame multiplexing 
process is terminated, the multiplexing controller 728(n) 
checks to see if it is time to switch from program data to 
commercial data (step Si 03). That is, a check is made 
to see if the starting time of a data insertion period has 
arrived. If the time to switch to commercial data has yet 
to be reached, the multiplexing controller 728(n) goes 
back to step SI 02 to resume control over the multiplex- 
ing process. In step SI 02, the next batch of multiple 
frames is subjected to the multiplexing process. In this 
manner, the multiplexing process is allowed to continue 
under control of the multiplexing controller 728(n) until 
it is time to switch to commercial data. 

When it is time to switch to commercial data, the 
multiplexing controller 728(n) requests the disk control- 
ler 762 to transfer the size data VSD and ASD denoting 
the sizes of commercial data (step SI 04). In turn, the 
multiplexing controller 728(n) is supplied with the size 
data VSD about video data and the size data ASD about 
audio data held in the size file SF(m) in the hard disk 
array 761 . In this case, too, the size data VSD and ASD 
are furnished in increments of a plurality of frames. 

On the basis of the size data VSD and ASD repre- 
senting the multiple frames from the disk controller 762, 
the multiplexing controller 728(n) devises a plan to mul- 



tiplex the plurality of frames of video data VD and audio 
data AD constituting the commercial data in question 
(step SI 05). 

In accordance with the multiplexing plan thus pro- 
5 vided, the multiplexing controller 728(n) requests the 
FIFO memory units 724(n) and 725(n) to transfer sepa- 
rately encoded streams representing the multiple 
frames. At the same time, the multiplexing controller 728 
(n) requests the multiplexer 727(n) to multiplex the plu- 

10 rality of frames of separately encoded streams. This 
causes the FIFO memory units 724(n) and 725{n) to out- 
put the multiple frames of separately encoded streams 
according to the multiplexing plan. These separately en- 
coded streams are multiplexed by the multiplexer 727 

'5 in accordance with the multiplexing plan. 

When control over the multiple-frame multiplexing 
process is terminated, the multiplexing controller 728(n) 
checks to see if the processing of one commercial mes- 
sage has ended (step S107). That is, a check is made 

20 to see if the ending time of the data insertion period has 
arrived. If the multiplexing process of one commercial 
message has yet to be terminated, the multiplexing con- 
troller 728{n) goes back to step SI 04 to resume control 
over the multiplexing process. The next batch of multiple 

2S frames is then subjected to the multiplexing process. In 
this manner, the multiplexing process is allowed to con- 
tinue under control of the multiplexing controller 728(n) 
until the processing of one commercial message comes 
to an end. 

30 When the multiplexing process of one commercial 
message has ended, the multiplexing controller 728(n) 
returns to step S101 . The multiplexing controller 728(n) 
again starts controlling the multiplexing process of the 
program data and repeat use data. In like manner, every 

35 time the multiplexing process of one commercial mes- 
sage has ended, the steps described above are repeat- 
ed. 

Fig. 8 is a flowchart of steps in which the disk con- 
troller 762 operates illustratively. How the disk controller 

40 762 works will now be described with reference to Fig. 8. 
The steps in Fig. 3 are carried out every time the 
- disk controller 762 receives a commercial data transfer 
request (output in step SI 01 of Fig. 7) from the multi- 
plexing controller 728(n). Initially, the disk controller 762 

45 calculates currently available capacities of the FIFO 
memory units 724(n) and 725(n) on the basts of the re- 
maining commercial data detected by the FIFO control 
circuit 726(n)(step S201). If the received transfer re- 
quest is a first request, the available capacities of the 

so FIFO memory units 724(n) and 725(n) should match 
their storage capacities. If the transfer request is a sec- 
ond or a subsequent request, the currently available ca- 
pacities match the data quantity of the commercial mes- 
sage CM(m) whose multiplexing process has just been 

55 terminated. 

The disk controller 762 then references a commer- 
cial list of the n channels to determine the commercial 
message CM(m) whose data should be transferred from 
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the hard disk array 761 to the FIFO memory units 724 
(n) and 725(n)(step S202). The commercial list is a list 
that designates the sequence in which commercial mes- 
sages CM(m) are to be output. The list is stored illustra- 
tively in an internal memory of the disk controller 762. 5 

The disk controller 762 then prepares the data mak- 
ing up the commercial message CM(n) determined in 
step S202 by an amount matching the available capac- 
ities calculated in step S201 (step S203). Specifically, 
those video data VD and audio data AD that match in io 
quantity the currently available capacities of the FIFO 
memory units 724(n) and 725(n) are read from the video 
file VF(m) and audio file AF(m) in the hard disk array 
761. 

The disk controller 762 transfers the prepared video '5 
data VD and audio data AD to the FIFO memory units 
724(n) and 725(n). This should fill the two memory units 
with data to capacity. 

The disk controller 762 checks to see if a request 
for the transfer of size data VSD and ASD (i.e., transfer 20 
request output in step Si 04 of Fig. 7) is received from 
the multiplexing controller 728(n)(step S205). The 
check is repeated until a transfer request has been sent 
in. 

With a transfer request received, the disk controller 2S 
762 transfers to the multiplexing controller 72e(n) the 
size data VSD and ASD on the commercial message 
CM(m) subject to multiplexing (step S206). The transfer 
is effected every time the size data VSD and ASD are 
read from the size file SF(m) in the hard disk array 761 . 30 
With each transfer request received, size data VSD and 
ASD representing a plurality of frames are transferred. 
The transfer of size data is continued until no further 
transfer request is received. 

With no further transfer request received, the proc- 3S 
ess of transferring size data VSD and ASD comes to an 
end. When the transfer process is terminated, the disk 
controller 762 stops its control operation. Upon receipt 
of a new request for the transfer of commercial data from 
the multiplexing controller 728(n), the steps above are 40 
again carried out. 

Fig. 9 is a view of a typical commercial list for n 
channels. The list in Fig. 9 shows a case in which com- 
mercial messages CM(m) numbered 1 , 2, 3. 4, etc., are 
sent out in the order of CM(r}, CM(2). CfVI(3). CM(6). 4S 
Cfvl(4), etc. 

Fig. 10 is a schematic view showing how the FIFO 
memory unit 724(n) is related in terms of storage capac- 
ity to the amount of video data VD to be accomnrodated 
thereinto. The video data VD in Fig. 10 are arranged in so 
the same sequence in which the corresponding com- 
mercial messages CM(m) are output. As illustrated, the 
storage capacity of the FIFO memory unit 724(n) is set 
to be large enough to hold video data VD representing 
a plurality of commercial messages CM(m). ss 

Figs. 11 A through 11C are schematic views show- 
ing how video data stored in the FIFO memory unit 724 
(n) vary. Fig. 1 1 A shows a case in which the multiplexing 



controller 72e(n) has yet to issue a request for the trans- 
fer of commercial data. In this case, the FIFO memory 
unit 724(n) has no video data VD stored therein. 

Fig. 11 B shows a case in which the multiplexing 
controller 726(n) has generated a first transfer request. 
In this case, the FIFO memory unit 724(n) accommo- 
dates illustratively video data VD representing two entire 
commercial messages ChA(A ) and ChA{2) and video data 
VD constituting part of a commercial message CM(3). 

Fig. 11c shows a case in which the multiplexing 
controller 728(n) has generated a second transfer re- 
quest. In this case, the FIFO memory unit 724(n) is re- 
plenished with the amount of data corresponding to the 
vacancy left when the commercial message CM(1 ) was 
read out. As indicated in Fig. 11C, the memory unit is 
replenished with video data VD constituting the rest of 
the commercial message CM(3) and video data VD rep- 
resenting part of a commercial message CM(6). Now 
the FIFO memory unit 724(n) is set illustratively with the 
video data VD representing the entire commercial mes- 
sages CM(2) and CM(3) as well as the video data VD 
constituting part of the commercial message CM(6). 

In like manner, every time the multiplexing controller 
728(n) generates a transfer request, the data-replenish- 
ing operation above is carried out. This keeps the FIFO 
memory unit 724(n) filled with video data. Similar 
processing, which will not be described further, is also 
performed on the FIFO memory unit 725(n) for audio 
data AD. 

As described and according to the embodiments of 
the invention above, repeat use data may be stored as 
compressed. This feature reduces the amount of stored 
repeat use data, which in turn cuts back on the storage 
capacity for accommodating the data and lowers the 
transfer rate at which repeat use data are transferred. 

With the embodiments of the invention, repeat use 
data may be stored in the form of separately encoded 
streams yet to be multiplexed. This feature dispenses 
with circuits for changing time base information, averts 
momentary interruption of video or audio data of the pro- 
gram, and suppresses generation of noise. 

The embodiments above multiplex repeat use data 
by simply installing several additional multiplexers 727 
(n) lor multiplexing program data. This arrangement 
forestalls increases in the scale of circuits. 

The embodiments comprise the FIFO memory units 
724(n) and 725(n) for buffer use which are fed with re- 
peal use data during the data noninsertion period. This 
feature further reduces the transfer rate for repeat use 
data. Specifically, the transfer rate of the inventive struc- 
ture is reduced to about T1/T2 (Tl stands for repeat use 
data output time and T2 for program data output time) 
compared with the second arrangement described ear- 
lier for inserting repeat use data into program data. This 
makes it possible to implement the hard disk array 761 
in the fonm of a hard disk array of a significantly lower 
speed than the one ordinarily used. In addition, a low- 
transfer-rate cable such as an RS232C cable may be 
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Utilized tor data transfer between the server 760, which 
is generally set up in a rennote location , and the encoder- 
multiplexers 720(n). 

Furthermore, the embodiments preserve the size 
data VSD and ASD acquired when repeat use data are 
compressed and encoded. This feature eliminates the 
need for a circuit to detect sizes of repeat use data. 

More specifically, if the size data VSD and ASD 
about repeat use data were not retained, it would be 
necessary to detect the sizes of these data by referenc- 
ing them upon read-out from the hard disk array 761. 
Such a structure would require separately installing a 
size detecting circuit. By contrast, the inventive structure 
holds the size data VSD and ASD obtained upon com- 
pression and encoding of repeat data, which makes a 
size detecting circuit unnecessary. Thus the embodi- 
ments help simply the entire circuit constitution. 

Where a plan to multiplex repeat use data is to be 
established, the inventive structure devises the plan on 
the bases of the size data representing a plurality of 
frames. This makes it possible to take into consideration 
the changes in data size per frame. The feature permits 
providing a more appropriate multiplexing plan than the 
ordinary setup of devising a multiplexing plan based on 
the single-frame size data. 

Although the description above contains many spe- 
cificities, these should not be construed as limiting the 
scope of the invention but as merely providing illustra- 
tions of the presently preferred embodiments of this in- 
vention. 

For example, the embodiments above have the 
FIFO memory units 724(n) and 725(n) as well as the 
FIFO control circuit 726(n) incorporated in each of the 
encoder-multiplexers 720(n). Alternatively, the incorpo- 
rated components may be included in the server 760 
instead. 

With the above embodiments, the file SF dedicated 
to size data is furnished so as to accommodate the size 
data VSD and ASD about repeat use data. As an alter- 
native, the size data may be contained in the video file 
VF or in the audio file AF. 

The embodiments above comprise a single stage 
of buffer memory units (FIFO memory units 724(n) and 
725{n) in the description above) for temporary storage 
of repeat use data. Alternatively, two stages of buffer 
memory units may be provided instead, the first stage 
making up a large-capacity buffer memory arrangement 
and the second stage constituting a small-capacity buff- 
er memory setup. 

Thus it is to be understood that changes and varia- 
tions may be made without departing from the scope of 
the claims that follow. 

The major benefits of this invention may be recapit- 
ulated as follows: according to the repeat use data in- 
serting apparatus or digital broadcast transmitting sys- 
tem of the invention, repeat use data are stored as com- 
pressed. This feature reduces the amount of stored re- 
peat use data, which in turn cuts back on the storage 



capacity for accommodating the data and lowers the 
transfer rate at which repeat use data are transferred. 

According to the repeat use data inserting appara- 
tus or digital broadcast transmitting system of the inven- 
5 tion, repeat use data are stored in the form of separately 
encoded streams yet to be multiplexed. This feature dis- 
penses with circuits for changing time base information, 
averts momentary interruption of video or audio data of 
the program, and suppresses generation of noise. 
10 Also according to the repeat use data inserting ap- 
paratus or digital broadcast transmitting system of the 
invention, repeat use data are multiplexed by simply 
providing some additional means for multiplexing pro- 
gram data. This forestalls increases in the overall scale 
^5 of circuits. 

According to the repeat use data inserting appara- 
tus or digital broadcast transmitting system of the inven- 
tion, temporary storage means is provided to accommo- 
date temporarily repeat storage data for each channel. 
During the data noninsertion period, repeat use data are 
transferred to the temporary storage means. This fea- 
ture further lowers the necessary transfer rate for repeat 
use data, which makes it possible to implement the re- 
peat use data holding means in the iovrr\ of data holding 
means of a significantly lower speed than the one ordi- 
narily used. 

Further according to the repeat use data inserting 
apparatus or digital broadcast transmitting system of the 
invention, repeat use data are preserved along with their 
size data. This feature eliminates the need for a circuit 
to detect sizes of repeat use data. 



1 . A repeat use data inserting apparatus for repeated- 
ly inserting repeat use data into program data in ac- 
cordance with appropriate timings, comprising; 

data holding means for holding said repeat use 
data made of a plurality of material data in the 
form of separately encoded streams; and 
data multiplexing means for multiplexing sepa- 
rately encoded streams of a plurality of material 
data constituting said program data during a 
period other than a data insertion period during 
which said repeat use data is inserted into said 
program data, said data multiplexing means 
further inserting repeatedly said repeat use da- 
ta into said program data during said data in- 
sertion period by multiplexing the separately 
encoded streams of said plurality of material 
data constituting said repeat use data held in 
said data holding means. 

2. A repeat use data inserting apparatus according to 
claim 1. further comprising temporary holding 
means for reading and temporarily holding the re- 
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peat use data from said data holding means during 
a period other than said data insertion period; 

wherein said data multiplexing means uses 
the repeat use data held in said temporary holding 
means in place of the repeat use data held in said s 
data holding means. 

3. A repeat use data inserting apparatus according to 
claim 2, wherein said temporary holding means in- 
cludes: 70 

holding means for temporarily holding said re- 
peal use data; 

remaining data detecting means for detecting 
the quantity of the repeat use data left in said '5 
holding means; and 

transfer means for transferring the repeat use 
data from said data holding means to said hold- 
ing means during a period other than said data 
insertion period in accordance with a detection 20 
output from said remaining data detecting 
means, so that the repeat use data held in said 
holding means will reach a predetermined 
quantity. 

2S 

4. A repeat use data inserting apparatus according to 
claim 1 , further comprising size data holding means 
for holding size data about each of said plurality of 
material data constituting said repeat use data; 

wherein said data multiplexing means multi- 30 
plexes. on the basis of said size data held in said 
size data holding means, the separately encoded 
streanns of said plurality of material data constituting 
said repeat use data held in said data holding 
means. 35 

5. A digital broadcast transmitting system for repeat- 
edly inserting repeat use data into program data so 
as to unify sard repeat use data and said program 
data into one data stream and for transmitting the 40 
unified data stream, said digital broadcast transmit- 
ting system comprising: 

program data encoding means for separately 
encoding a plurality of material data constilut- 45 
ing said program data in order to generate the 
separately encoded streams of the material da- 
ta; 

data holding means for holding said repeat use 
data made of a plurality of material data in the so 
form of separately encoded streams; and 
data multiplexing means for multiplexing, dur- 
ing a period other than a data insertion period 
during which said repeat use data is inserted 
into said program data, the separately encoded ss 
streams of said plurality of material data con- 
stituting said program data output from said 
program data encoding means, said data mul- 



tiplexing means further inserting repeatedly 
said repeat use data into said program data in 
accordance with appropriate timings during 
said data insertion period by multiplexing the 
separately encoded streams of said plurality of 
rraterial data constituting said repeat use data 
held in said data holding means. 

6. A digital broadcast transmitting system according 
to claim 5, further comprising temporary holding 
means for reading and temporarily holding the re- 
peat use data from said data holding means during 
a period other than said data insertion period; 

wherein said data multiplexing means uses 
the repeat use data held in said temporary holding 
means in place of the repeat use data held in said 
data holding means. 

7. A digital broadcast transmitting system according 
to claim 6. wherein said temporary holding means 
includes: 

holding means for temporarily holding said re- 
peat use data; 

remaining data detecting means for detecting 
the quantity of the repeat use data left in said 
holding means; and 

transfer means for transferring the repeat use 
data from sard data holding means to said hold- 
ing means during a period other than said data 
insertion period in accordance with a detection 
output from said remaining data detecting 
means, so that the repeat use data held in said 
holding means will reach a predetermined 
quantity. 

8. A digital broadcast transmitting system according 
to claim 5, further comprising size data holding 
means for holding size data about each of said plu- 
rality of material data constituting said repeat use 
data; 

wherein said data multiplexing means multi- 
plexes, on the basis of said size data held in said 
size data holding means, the separately encoded 
streams of said plurality of material data constituting 
said repeat use data held in said data holding 
means. 

9. A digital broadcast transmitting system according 
to claim 5, wherein said program data encoding 
means receives a plurality of channels of program 
data and separately encodes each of said plurality 
of channels of program data; and 

wherein said data multiplexing means receives 
said plurality of channels of program data en- 
coded by said data encoding means, and mul- 
tiplexes each of said plurality of channels of 
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program data with said repeat use data; 
said digital broadcast transmitting system fur- 
ther comprising multi-channel developing 
means for developing into multiple channels 
sad plurality of channels of multiplexed outputs 
from said data multiplexing means. 
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